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Abstract 

We introduce concepts of "recursive polynomial remainder sequence (PRS)" and 
"recursive subresultant," along with investigation of their properties. A recursive 
PRS is defined as, if there exists the GCD (greatest common divisor) of initial poly- 
nomials, a sequence of PRSs calculated "recursively" for the GCD and its derivative 
until a constant is derived, and recursive subresultants are defined by determinants 
representing the coefficients in recursive PRS as functions of coefficients of initial 
polynomials. We give three different constructions of subresultant matrices for re- 
cursive subresultants; while the first one is built-up just with previously defined 
matrices thus the size of the matrix increases fast as the recursion deepens, the last 
one reduces the size of the matrix drastically by the Gaussian elimination on the 
second one which has a "nested" expression, i.e. a Sylvester matrix whose elements 
are themselves determinants. 

Key words: polynomial remainder sequence, subresultants, Gaussian elimination, 
Sylvester's identity 



1 Introduction 



The polynomial remainder sequence (PRS) is one of the most fundamental 
tools in computer algebra. Although the Euclidean algorithm (see Knuth [10J ) 
for calculating PRS is simple, coefficient growth in PRS makes the Euclidean 
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algorithm often very inefficient. To overcome this problem, the mechanism of 
coefficient growth has been extensively studied through the theory of subre- 
sultants; see Collins [3J, Brown and Traub [2J, Loos [12j, etc. By the theory 
of subresultant, we can remove extraneous factors of the elements of PRS 
systematically. 



In this paper, we consider a variation of the subresultant. When we calcu- 
late PRS for polynomials which have a nontrivial GCD, we usually stop the 
calculation with the GCD. However, it is sometimes useful to continue the 
calculation by calculating the PRS for the GCD and its derivative; this is nec- 
essary for calculating the number of real zeros including their multiplicities. 
We call such a PRS a "recursive PRS." 



Although the theory of subresultants has been developed widely, the corre- 
sponding theory for recursive PRS is still unknown within the author's knowl- 
edge; this is the main problem which we investigate in this paper. By "recursive 
subresultants," we denote determinants which represent elements of recursive 
PRS as functions of the coefficients of initial polynomials. 



We give three different constructions of subresultant matrices to express re- 
cursive subresultants in this paper. The first matrix construction recursively 
builds the matrix by shifting previously defined matrices, similarly as the 
Sylvester matrix shifts coefficients of the initial polynomials, thus the size of 
the matrices increases fast as the recursion deepens. The second matrix con- 
struction uses "nested" matrices, or a Sylvester matrix whose entries are them- 
selves determinants. Finally, by the Gaussian elimination with the Sylvester's 
identity on the second construction, we succeed to give the reduced matrix 
construction which expresses the coefficients of the polynomials in the recur- 
sive PRS as determinants of very small matrices, whose size actually decreases 
as the recursion deepens. 



This paper is organized as follows. In Sect. [2J, we introduce the concept of 
recursive PRS. In Sect. [3J we define recursive subresultant and show its re- 
lationship to recursive PRS. In Sect. [H we define the "nested subresultant," 
which is derived from the second construction of subresultant matrix, and 
show its equivalence to the recursive subresultant. In Sect. \5\ we define the 
"reduced nested subresultant," whose matrix is derived from the nested subre- 
sultant, and show that it is a reduced expression of the recursive subresultant. 
In Sect. [6j we briefly discuss usage of the reduced nested subresultant in ap- 
proximate algebraic computation. 
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2 Recursive Polynomial Remainder Sequence (PRS) 



First, we review the PRS, then define the recursive PRS. In the end of this sec- 
tion, we show a recursive Sturm sequence as an example of recursive PRS. We 
follow definitions and notations by von zur Gathen and Lucking [5]. Through- 
out this paper, let R be an integral domain and K be its quotient field. We 
define a polynomial remainder sequence as follows. 

Definition 2.1 (Polynomial Remainder Sequence (PRS)) Let F and 

G be polynomials in R[x] of degree m and n (m > n), respectively. A sequence 

(Pu-..,Pi) 

of nonzero polynomials is called a polynomial remainder sequence (PRS) for 
F and G, abbreviated to prs(P, G), if it satisfies 

Pi = P, P2 — G, ctiPi-2 = qi-iPi-i + PiPi, 

for i = 3, . . . , I, where a^, fa, . . . , 0i are elements of R and deg(p_i) > 
deg(Pj). A sequence ((0J3, j3 3 ), . . . , (a;,/3/)) is called a division rule for 
prs(F, G). If Pi is a constant, then the PRS is called complete. □ 

If F and G are coprime, the last element in the complete PRS for F and G is a 
constant. Otherwise, it equals the GCD of F and G up to a constant: we have 
prs(F, G) = (Pi = F, P 2 = G, . . . , Pi = 7 • gcd(F, G)) for some 7 G R. Then, 
we can calculate new PRS, prs(Pj, 4-Pi), and if this PRS ends with a non- 
constant polynomial, then calculate another PRS for the last element, and so 
on. By repeating this calculation, we can calculate several PRSs "recursively" 
such that the last polynomial in the last sequence is a constant. Thus, we 
define "recursive PRS" as follows. 

Definition 2.2 (Recursive PRS) Let F and G be the same as in Defini- 
tion \2.1\ Then, a sequence 

fpO) p(l) p(2) p(2) p (t) p (tK 

\ 1 > • • • > Mi 1*1 i - • • i r h 1 ■ ■ ■ ■> r \ i- ■ ■ i r | t ) 

of nonzero polynomials is called a recursive polynomial remainder sequence 
(recursive PRS) for F and G, abbreviated to rprs(F, G), if it satisfies 

P« = F , P 2 (1) = G, Pj$ = 71 • gcd(P 1 (1) , P 2 (1) ) with 71 e R, 
(PV,P?\...,PV)= WS (P?\PM), 



d_ 

da 

(pr,p 2 w ,...,pr)=prs(pr,p 2 w ), 



pW = P (k-i\ Pi k) = ±Pt?i Pt = i k -gcd(Pl k \pM)with lk eR, 
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for k = 2,..., t. If <4 k \ eR satisfy 

Ak) p(fe) _ (k) p(k) n{k) p (fc) 
a i r i-2 — li-l^i-l i* Pi 

for k — 1, . . . , t and i — 3, . . . , lk, then a sequence ((ajj 1 , /?3 ), . . . , , $ )) 
is called a division rule for rprs(P, G). Furthermore, if is a constant, then 
the recursive PRS is called complete. □ 

Remark 2.3 In this paper, we use the following notations unless otherwise 
defined: for k = 1, . . . , t and i = 1, . . . , l k , let = lc(P^), = deg(P/ fc ^) 
(letters lc and deg denote the leading coefficient and the degree of the poly- 
nomial, respectively), jo = m and jk = ti^\ and let = — nj+i for 
k = 1, . . . , t and i = 1, . . . , 1% — 1. Furthermore, we represent P^ k \x) as 



and its "coefficient vector" as 

„(*) _ t ( (k) (k). 



As an example of recursive PRS, we calculate Sturm sequences recursively 
for calculating the number of real zeros of univariate polynomial including 
multiplicities (see Bochnak, Coste and Roy as follows. 

Example 2.4 (Recursive Sturm Sequence) let P(x) — (x + 2) 2 {(x — 
3)(x + l)} 3 , and calculate the recursive Sturm sequence of P(x) as 

(complete) rprs(P(x), —P(x)), 

dx 

with division rule given by 

{ci h \t$ K >) = (1,-1), 
for k — 1, . . . ,t and % — 3, . . . , lk- 

The first sequence I\ = (Pi , • • • , P^) has the following elements: 
p« = P( x ) = ( x + 2 ) 2 {(x - 3)(x + l)} 3 , 

p« = ^-P(x) = 8x 7 - 14x 6 - 102a; 5 + 80x 4 + 460a; 3 + QQx 2 - 558x - 324, 
dx 

m 75 fi 45 - . 225 , 3315 „ 4815 945 

p "' = IT - 15* - 601 - IT + ir 1 + ~W X + X' 

n m 128 - 256 , 256 , 1024 „ 4224 2304 

Pr = x 5 x 4 x s H x 2 H x H . 

4 25 25 5 25 25 25 
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The second sequence L 2 = {P^\ ■ ■ ■ , P}^) has the following elements: 

p (2) _ p(D _ 128 256 256 1024 4224 2304 

^ " n " 25 X " 25 X 5 X + 25 X + 25 X + 25 ' 
,(2) _ d (1) _ 128 4 1024 3 768 2 2048 4224 



P 2 ^ = _p 4 ^ = — X * - —^x A - —x A + -^x + 
14848 , 1536 9 88576 66048 



dx " 5 25 5 25 25 ' 

(2) _ 14848 3 _ 1536 , 



625 125 625 625 ' 

12800 n 25600 38400 



pf = ^* 2 - — , 



841 841 841 

77ie /asi sequence L 3 = (Pp\ . . . , P^) has the following elements: 
, 3) r 2) 12800 2 25600 38400 

Pi ' — P) — X X , 

1 4 841 841 841 ' 
p (3) _ d (2) _ 25600 25600 

2 ~ dx 4 ~ 841 * 841 ' 
(3) = 51200 

3 841 

For PRS L k , k — 1,2, 3, define sequences of nonzero real numbers \(L k , — oo) 
and A(Lfc, +oo) as 

A(L fe , -oo) = ((-l^lc^), . . . , (-l)< fe) lc(Pf } )), 
A(L fe ,+oo) = (lc(P 1 W ),...,lc(P/ fe fc) )), 

where nf^ = deg(P^) denotes the degree of P/^ and lc(P/ fc ' ) ) denotes the 
leading coefficients of Pj; k \ Then, A(L fc , — oo) and \(L k ,+oo) for k = 1,2,3 
are 

75 1 98 
A(Li,±oo) = (1,±8,— ,±— ), 
v ' ; v ' ' 16' 25 ; ' 

x . , 128 128 , 18848 12800, 

A L 2 ,±oo = ± , ,± , , 

v ' ; 1 25 5 625 841 ; ' 

x ,12800 , 25600 51200, 

A L^+oo = ,± , . 

V 3 ' ; V 841 ' 841 ' 841 ; 

For a sequence of nonzero real numbers L = (a±, . . . , a m ) , let V(L) be the 
number of sign variations of the elements of L. Then, we calculate the number 
of the real zeros of P(x), including multiplicity, as 

3 

J2{V(X(L k , -oo)) - V(X(L k , +oo))} = 3 + 3 + 2 = 8. □ 

k=l 
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3 Subresultants for Recursive PRS 



To make this paper self-contained and to use notations in our definitions, we 
first review the fundamental theorem of subresultants, then discuss subresul- 
tants for recursive PRS. 

Although the theory of subresultants is established for polynomials over an 
integral domain, in what follows, we handle polynomials over a field for the 
sake of simplicity Let F and G be polynomials in K[x] such that 



F(x) = f m x m + ■■■ + f x°, G(x) = g n x n + ■■■ + g x°, 



(3.1) 



with m > n > 0. For a square matrix M, we denote its determinant by \M\. 



3. 1 Fundamental Theorem of Subresultants 



Definition 3.1 (Sylvester Matrix) Let F and G be as in (jO) . The 

Sylvester matrix of F and G, denoted by N(F, G), is an (m + n) x (m + n) 
matrix constructed from the coefficients of F and G, such that 



N(F,G) 



fo fm 90 9r, 



fo 



go J 



□ 



Definition 3.2 (Subresultant Matrix) Let F andG be defined as in (13.11) . 

For j < n, the j-th subresultant matrix of F and G, denoted by N^(F,G), 
is an (m + n — j) x [m + n — 2j) sub-matrix of N(F,G) obtained by taking the 
left n — j columns of coefficients of F and the leftm — j columns of coefficients 



6 



of G, such that 



N {j \F,G) 



fn 



fo fm 90 9n 



fo 



9oJ 



n-j 



m-j 



Furthermore, define N^(F,G) as a sub-matrix of N^(F,G) by deleting the 
bottom j + 1 rows. □ 

Definition 3.3 (Subresultant) Let F and G be defined as in (13. ip . For 



j < n and k = 0, . . . , j , let N ( k j) = N^'(F, G) (distinguish it from Ntf>(F, G) in 
the above) be a sub-matrix of N^\F, G) obtained by taking the top m+n—2j — l 
rows and the (m + n — j — k)-th row (note that Nj^\F,G) is a square matrix). 
Then, the polynomial 



r(?) 



00, 



Sj&G) = |A/fV + --- + l^ 
is called the j-th subresultant of F and G. □ 



Theorem 3.4 (Fundamental Theorem of Subresultants [2]) Let F 

and G be defined as in (13. ip . (Pi, . . . , Pk) = prs(F, G) be complete PRS, and 
((«3, (3s), . . . , (ajfc, 0k)) be its division rule. Let rii = deg(Pj) and q = lc(Pj) 
for i = 1, . . . , k, and di = — n i+1 for % = 1, . . . , k — 1. Then, we have 



Sj(F,G) = forO<j<n k , 
S ni (F,G) = P i d 



rfi— 1— 1 



X 



n{(- 



ni-i-rii 



Sj(F, G) = for n { < j < m-i - 1, 



(3.2) 

(r»i-a-»»j)(wi-i-Wi) 1 ^3 3^ 

(3.4) 



x c 



Z-l 



(_]_^( n !-2- n i-l+ 1 )( n ;-l- n i-l + 1 ) I 



(3.5) 



for i = 3, . . . , k. □ 

By the Fundamental Theorem of subresultants, we can express coefficients of 
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PRS by determinants of matrices whose elements are the coefficients of initial 
polynomials. 



3.2 Recursive Subresultants 



We construct "recursive subresultant matrix" whose determinants represent 
elements of recursive PRS by the coefficients of initial polynomials. To help 
the readers, we first show an example of recursive subresultant matrix for the 
recursive Sturm sequence in Example 12.41 

Example 3.5 (Recursive Subresultant Matrix) We express P(x) and 
j-P(x) in Example \2.4 by 



P{x) = f 8 x 8 + --- + f x , ^-P(x 

ax 



g 7 x 7 H V gox°. 



Let N^ 5 \F, G) = N®(F, G), then the matrices A#' 5) (F, G), n£' 5) (F, G) and 
N^ 1,5 \f,G) are given as 



N {1 ' 5 \F,G) 



Vvf 5 > 



fa 97 
fl h 96 97 
h h 95 96 97 
h fe 9i 95 9e 



h h 93 94 95 
/a h 92 93 94 
$2 h 9i 92 93 
h f2 9o 9i 92 
fo fi 9o Sh. 
\ fo 9oJ 
^5/ 4 5/5 5^3 5g 4 5g 5 ^ 
4/3 4/4 4^ 2 Ag 3 Ag 4 
3/2 3/3 3g x 3g 2 3g 3 
2/i 2/ 2 2g 2g x 2g 2 

\ fo fi go 91 ) 

where horizontal lines in matrices divide them into the upper and the lower 
components. Note that the matrix iV'( 1,5 )(F, G) is derived from Ni~' 5 \f, G) by 



N 



'(1,5), 



F,G) 
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multiplying the l-th row by 6 — I for I = 1, ... ,5 and deleting the bottom row. 
Then, the (2,3)-th recursive subresultant matrix N^ 2 ' 3 \F, G) is constructed as 



N {2 ' 3 \F,G) 



V 

























0---0 


^(1,5) 


^(1,5) 






0---0 





□ 



(3.6) 



Definition 3.6 (Recursive Subresultant Matrix) Let F and G be 

defined as in (13.11) . and let (Pi , ■ ■ ■ , Pu , ■ ■ ■ , P\ , . . . , PP) be complete re- 
cursive PRS for F and G as in Definition \2.2\ Then, for each pair of num- 
bers (k, j) with k = 1, . . . , t and j = j^-x — 2, . . . , 0, define matrix N^ k '^ = 
N^ k '^ (F, G) recursively as follows. 

(1) For k=l, let N^' j \F, G) = N ij \F, G). 

(2) Fork>\, let N^(F, G) consist of the upper block and the lower block, 
defined as follows: 

(a) The upper block is partitioned into (2jk-i — 2j — 1) x (2j^._ 1 — 2j — 1) 
blocks with the diagonal blocks filled with JSfjj 1 ' Jfe - 1 ' ) ; where 1 '^ k - 1 > 
is a sub-matrix of N^ 1 '^- 1 ' (F, G) obtained by deleting the bottom 
jk-i + 1 rows. 



(b) Let Nl 



(k-l,j k _ 1 ) 



be a sub-matrix of N^ k 1 J fe - 1 ) obtained by taking the 



bottom jk-i+l rows, and let jv^p -1 ' 3 '* -1 ^ be a sub-matrix of N < ^~ 1 ' jk - 1 ' ) 
by multiplying the (jk-i + 1 — r)-th rows by r for r = jk-i, ■ ■ ■ A, 
then by deleting the bottom row. Then, the lower block consists of 
jk-i ~ J : ~ 1 blocks of such that the leftmost block is placed 

at the top row of the container block and the right-side block is placed 
down by 1 row from the left-side block, then followed by jk-i—j blocks 
of N^ k x ^ k ~ x ' placed by the same manner as l ^ k ~ 1 \ 

As a result, N^'(F,G) becomes as shown in Fig. \J\ Then, N^ k '^'(F,G) is 
called the (k,j)-th recursive subresultant matrix of F and G. □ 

Proposition 3.7 The numbers of rows and columns of N^ k '^(F,G), the 
(k,j)-th recursive subresultant matrix of F and G, are as follows: for k = 1 
and j < n, they are equal to 



m + n — j and m + n — 2j, 



(3.7) 
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respectively, and, for (k,j) = (1, ji) and k = 2, . . . ,t and j < jk-i — 1, they 
are equal to 

(m + n- 2j x ) | n(2j,_i - 2j, - 1) j (2j fc _i - 2j - 1) + j (3.8) 

and 

(m + n- 2j x ) | n(2^-i - 2j t - 1) j (2j fc _! - 2j - 1), (3.9) 
respectively, with j = ji + 1 /or (fc, j) = (1, ji). 

PROOF. By induction on k. For k = 1, (13. 7p immediately follows from Case 
1 of Definition 13. 6[ and we also have (13. 8p and (13.91) for (k, j) = (1, ji). Let us 
assume that we have (13.81) and (13. 9p for 1, . . . , k — 1. Then, we calculate the 
numbers of the rows and columns of N^ k >^(F, G) as follows. 

(1) The numbers of rows of 1 ' : ' k ~ 1 ' and N^ k are equal to jk-i + 1 
and jk-i, respectively, thus the number of rows a block which consists of 
jy<fe-ij fc -i) and tf(k-i,j k -i) in N( k >rt(F,G) equals 

2^-x-j-l. (3.10) 

On the other hand, the number of rows of N$ is equal to (m + 

n — 2ji){nf=2 1 (2j/-i — 2ji — 1)} — 1, thus the number of rows of diagonal 
blocks in N^ k ' j \F, G) is equal to 

|( m + n _ 2jl ) - 2j, - 1) - l| (2j fc _! - 2j - 1). (3.11) 

By adding (EUOl) and (13TTTD . we obtain (BHD - 

(2) The number of columns of N ( - k ~ 1 ^ k ~ 1 \F,G) is equal to (m + n — 2ji) 
x {nf=2 1 (2jz-i — 2j/ — 1)}, hence the number of columns of N^ k ' j \F, G) is 
equal to (13. 9p . 

This proves the proposition. □ 



Now, we define recursive subresultants. 

Definition 3.8 (Recursive Subresultant) Let F and G be defined as in 
( ED , and let (P^ , P®, . . . , pf\ . . . , P®) be complete recursive PRS for 
F and G as in Definition \2.2l For j = j k _i — 2, . . . , and r = j, . . . , 0, let 
j\j(k,j) _ j\K fc, ^(F, G) be a sub-matrix of the (k,j)-th recursive subresultant 
matrix N^ k '^(F,G) obtained by taking the top (m + n — 2ji){nf=2 1 (2j;-i — 
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2ji - l)}(2j fc _! - 2j - 1) - 1 rows and tfie ((m + n - 2i 1 ){nf= 2 1 (2^_ 1 - 2 3l - 

l)}(2jfe_i — 2j — 1) +j — rj -th row (note that N&'fi is a square matrix). Then, 
the polynomial 

S ktj (F,G) = |i\f J V + • • • + lA^'V 

is called the (k,j)-th recursive subresultant of F and G. □ 

We show the relationship between recursive subresultants and coefficients in 
the recursive PRS. 

Lemma 3.9 Let F and G be defined as in (13.11) . and let {P\\ . . . , P^\ ■ ■ ■ , 

P\ \ . . . , Pi ) be complete recursive PRS for F and G as in Definition \2.SX 
For k = 1, . . . , t — 1, define 

1=3 I \<*2 

For k — 2, . . . , t and j = jk-i — 2, . . . , 0, define 

u k>j = (m + n - 2j0 | J] (2ji-i ~ 2 3l - 1) j (2j k ^ - 2j - 1) 

with Uk = Uk,j k and u\ = m + n — 2j\, 
b k ,j = 2j fc _i - 2j - 1 with b k = b kdk and b ld = 1 for j < n, 
r kJ = W ith r k = r kJk and r hj = 1 for j < n, 

R k = (R k ^ 1 ) h r k B k with R = 1. 

Then, for the (k,j)-th recursive subresultant of F and G with k — 1, . . . ,t and 
j = j fe _i - 2, . . . , 0, we have 

S k>j (F,G) = (li, t^n^ ■ S,(Pt\Pi k) ). (3.12) 
To prove Lemma [3. 9[ we prove the following lemma. 

Lemma 3.10 For k = 1, . . . , t, j = j k -\ — 2, . . . , and t = j, . . . ,0, we have 
\N^\F,G)\ = (R k ^r kj \N^(Pi k \p^)\. 



PROOF. By induction on k. For k = 1, it is obvious from Case 1 in Defini- 
tion 13. 61 Let us assume that the lemma is valid for 1 , . . . , k — 1 , then we prove 
the claim for k by the following steps. 



( c i l) (~ 1) fe l^ n l~l~ n l k > 
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Lemma 3.11 Assume that we have Lemma \3.10\ for 1. . . . . k — 1. Then, fork, 
j = jk-\ — 2, . . . , and r = j, . . . , 0, N^ k '^(F, G) can be transformed by certain 
eliminations and permutations on its columns into M^ k, ^{F^G) as shown in 
Fig. [I| satisfying 

\N^\F,G)\ = {{R k ^) b ^r k ^\M^\F,G)\, (3.13) 

where M^(F,G) is a sub-matrix of M^ k >^(F, G) obtained by the same man- 
ner as we have obtained N^ j \F, G) from N^ j \F, G) in Definition\3M 



PROOF. By the induction hypothesis, for r' = jk-i, . . . , 0, we have 
Let N'( k >fi (F, G) be a matrix defined as 



N'^\F,G) 



N, 



u 



N '(k,j) 



where and N'^ i] are defined as in Definition 13.61 Furthermore, let 

jV'O'^i^pf-^pf- 1 )) be defined as N^\p[ k P 2 (fc with the (j fc _ 2 + 
1 — r)-th row multiplied by r for r = jk-i, ■ ■ ■ , 1, then by deleting the bot- 
tom row, N$}'- 1 \pl k P 2 (fc_1) ) be a sub-matrix of jV^-i)(pf Pp -1 ^ and 
(fe-i) p(fc-i)^ 



; - 1 2 



by taking the top jfc„ 2 



rows, and 



JSf'Uk-i) (pi 

and N , 1 lf'- 1 \pl k - 1 \pi k - u ' 
N^^P^ , P^~ 1} ) and jV'^-^Pf^P?^), respectively, by eliminat- 



W;-0/p(fc-l) p^- 1 ) 
(ft-1)' D (ft-1) 

ing the top j fc _ 2 - Jfc-i rows 



be sub-matrices of 



Then, by certain eliminations and exchanges on columns, we can transform 
#(*-i.^-i)(p,G) and N'^'^-^^F, G) to 

D^ jk -^(F,G) 



fc-1 



V 



o 



a^-O^- 1 )^- 1 )) 

D ,( ^ ljfc - l} (P,G) 
A 



V 



o 





o ^ 


* 




v * 





* 




v * 





(3.14) 
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respectively, satisfying 



-i 



1 



(F,G)\ 
(F,G)\ 



(^- 2 )^- 1 r*_i|^- l) (P 1 ( *- 1, J P 2 C *- 1, )|, 
( J R fc _ 2 ) 6 - 1 r fe _ 1 |iV^- ) (P 1 ( fc - 1 ),Pi fc - 1 ))|, 



where Z$ 1Jfc - l} (F, G) and D'J ^''(F.G) are sub-matrices of 
D( k ~ 1 '^-i)(F,G) and D'^' 1 '^ (F, G), respectively, obtained by the same 
manner as we have obtained N^* 1 '*"' 1 ' (F, G) from N^ -1 ^- 1 ^ (F, G) (see Def- 
inition 13.81) . 

Therefore, by the above transformations on the columns in each column blocks 
in N^ k '^(F, G) as shown in Fig. [Q we obtain M^ k '^(F, G) as shown in Fig. [2J 
where N u ^\p[ k ~ X \ P 2 M ), iV^-^Pf Pf^) and 

jY/Ofe-i)^-!)^'-!)) are abbreviated to A^- 1 ), iV^-i) and N' L ^ k ^ x \ re- 
spectively, satisfying (13 . 13[) because M^'{F,G) has frfcj = 2j & _ 1 — 2j — 1 
column blocks that have D ( - k ~ 1 ' jk - l \F, G) or D' {k ' 1,jk - l) {F,G). This proves 
the lemma. □ 

Lemma 3.12 For k, j = j k _ x - 2, . . . , and r = j, . . . , 0, M^ k ' j \F, G) can 
be transformed by certain eliminations and permutations on its columns into 
M^ k, ^{F,G) as shown in Fig. 0, satisfying 



where Mff'^ is a sub-matrix of M^ k ^ obtained by the same manner as we 
have obtained JV^-ij'fc-i) j rom jy(k-i,jk-i) { n Definition \3.8[ 



PROOF. For N' {jk - l} {P[ k ^\ P^ 1] ) (defined as in the proof of Lemma EI]) 
and t" = i fc _! - 1,...,0, let N'^t^ {P[ k ~ l \ P 2 ( *~ 1) ) be a sub-matrix of 
N ,Uk-i)(p(k-i)^ p (k-i)^ obtained by taking the top 2(nf _1) - j k _x - 1) rows 
and the (2n k ^ — 2 — jf.-i — r")-th row. Then, by the Fundamental Theorem 
of subresultants (Theorem I3.4j) . we have 



\M.^\F,G)\ = (B k ^\M^(F,G)\ 7 



(3.15) 
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hence, for r' = jk-i, • • • , and r" = jk-i — 1, . . . , 0, we have 

\N^\pt 1 \Pt 1) )\ = B k - 1 a[%, 
\N'^- 1 \Pt 1 \Pt 1) )\ = B k - l af} ll , 

where a^} represents the coefficient of degree j of Pi k) (see Remark 12.31) . 
Therefore, by certain eliminations and exchanges on columns, we can trans- 
form N^-^(Pi k ~ l \pi k ~ 1] ) and A^-^pf-^pf- 1 )) into 







(k) 
Pi 



and 







respectively, satisfying \N^ k | = 1 (see Remark 12.31 for the notation of "coef- 
ficient vectors"). By these transformations, we can transform D^-^^^F, G) 
and D ,( *~ 1 ' i *- l) (i? , ,G) in (ETT3I) to 














\ 


Jj(k-l,jk- 


1 \F,G) = 






-0 








I * 





(fc) 
Pi J 

\ 




- l] (F,G) = 




N^ k 


-i) 








{ * 






(k) 

pV ) 



respectively, satisfying 



|7V# fe - lj | = 1, 
\n^-^\ F ,G)\ = fi fc _ 1 | J Dj- 1 '^(F ; G')| ) 
^ fc - 1Jfc -°(F,G)| = B k . 1 \D'S k ~ 1Jk - 1 \F,Cf)\, 



where D^- 1 '^-^ of' 1 '^, D^' 1 ,jk - x) _ and Df~ 1,jk - l] are sub-matrices of 
£?(fc-ijk- 1 ) > £)'(fc-i,ifc-i) ) £)(fc-ij*-i) anc ; £)/(fc-iJk- 1 ) ) respectively, obtained by 

the same manner as we have obtained 1 >^ h - 1 ^ from iV^~ 1 ' J ' fe - 1 \ Therefore, 
by the above eliminations on the columns in each column blocks, we can trans- 
form M (k ^(F, G) to M^(F, G) as shown in Fig. [3] satisfying (13151) because 
M^\F, G) has = 2jV-i — 2j — 1 column blocks that have D^- k ~ 1 ' jk - 1 \F, G) 
or proves the lemma. □ 
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Proof of Lemma \3.1C\ (continued). By exchanges on column blocks, we can 
transform M^\F, G) to M (k > j \F, G) as shown in Fig. HJ with 

\M^\F,G)\ = r kd \M^(F,G)\, (3.16) 

where M^ j) is a sub-matrix of M^ k '^ obtained by the same manner as we 
have obtained from N^ k ^\ because the (u k j — (I — l)-Ufc_i)-th column 

in M^ j \F,G) was moved to the (u kd - (I - l))-th column in M^ j \F,G) 
for 1=1,..., b kJ . (Note that M^\F, G) is a block lower triangular matrix.) 
Then, we have 

\M^ j \F, GO | = \N®{Pj; k \ P 2 (fc) )|, (3.17) 

because we have |Wfc_i| = | N^ k ~^\ = 1 and the lower-right block of p^s and 
pj°s in M^(F, G) is equal to N^(Pi k) , P 2 (fe) ). 

Finally, from fl3~T3|) . fl3~T5l) . (T37T6T) and (I3T7I) . we have 

\N^\F,G)\ = ((^- 2 ) 6fe - 1 r fc _0 6ft ' 3 '(^-i) 6fe ^*jl^ i HA (fe \A (fc) )l 
= (fl fc -i)^r w |iVW(P 1 w ,P 2 w )|, 

which proves the lemma. □ 



Theorem 3.13 VFrf/i t/ie same conditions as in Lemma \3.9[ and for k = 
1, . . . , t and i = 3,4, . . . ,lk, we have 

S k}j (F,G)=0 /orO<i<n[ fc fe) , (3.18) 
S kn{k) (F,G) = Pi k \^ ) Y^'\R k -i) bk ^ ) r k ^ 

/ (k\ \ n l—l~ n I 

" 1 (c Wj(^Ue\) ( _i)(^ ) 2 -f , )K w 1 -f ) ) , (3.19) 
S k , 3 (F, G) = for n ( t ] < j < nf\ - 1, (3.20) 

x (^(^S^ (3.21) 



PROOF. By substituting 8j{Pr\PP) in fl3TT2|) by Q-^, we obtain 
(!3TTg|l - (l3T2Tp . respectively. □ 
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We show an example of the proof of Lemma T3.9I for the recursive subresultant 
matrix in Example 13.51 



Example 3.14 ( Continued from Example \3.5[ ) Since we have N^' 5 \F, G) = 
N®(F,G), we can regard N^(F,G) and N ,(1 ' 5) (F,G) as D^(F,G) and 
D'^ l ^\F,G) in \3.1$ , respectively. Then, by eliminations and exchanges of 



columns as shown in Lemma \3.1%\ we can transform N^' 5 '(F,G) 



N, 



(1.5) 



and N'^(F,G) 
spectively, as 



(1,5) 



N 



(1,5) 



in (ESP to D^(F,G) and D'^(F,G), re- 



D^ 5 \F,G) 








* 





D'^ 5 \F,G) 








* 





with \N, 



(5) I 

u I 



1 and B\ 



" 1 ! - 1 '^ 2 . Therefore, by the above transforma- 



iCLiji (a 



3,6; 



tions of columns in each column blocks in N^ 2,1 \F, G) , we have 



MW(F,G) 




















































•0 


* 


(2) 

Pi 


* 


(2) 
P 2 


* 


(2) 
P2 






0- • 


■0 







satisfying \N^(F, G)\ = (Bi) 3 \M?> 3 \F, G)\ for r = 3, . . . , 0. Furth 



ermore, 
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by exchanges of columns, we can transform M^ 2 ' 3 \F,G) to M^ 2 ' 3 \F,G) as 
M (2 ' 3) (F,G) 













\ 






u 






























0---0 











* 


* 


* 


(2) 

Pi 


(2) 
P 2 


(2) 
P 2 






0---0 




















\ 


















* 


n®(p1 2 \pP) ) 



V 



satisfying \M™(F,G)\ = r 2>3 \M^\F,G)\ = r 2>3 (^(P^, P 2 (2) )|. There- 
fore, we have 

\N^\F,G)\ = { Bl fr 2 ,z |AT(3)(pf),pf )| = ( Rl fr 2 , 3 |iV^(pf, pf )|, 
for r = 3, . . . , 0, and we have 



S 2 , 3 (F, G) = (P0 3 r 2 ,3 • S 3 (P 1 (2 \ Pf) = {(aa) 2 (a«) 2 } 3 (4 2 !) 2 Pf- ° 



4 Nested Subresultants 



As we have seen in the above, the recursive subresultant can represent the 
coefficients of the elements in recursive PRS. However, the size of the recursive 
subresultant matrix becomes larger rapidly as the recursion of the recursive 
PRS deepens, thus making use of the recursive subresultant matrix become 
inefficient. 

To overcome this problem, we should introduce other representations for the 
subresultant that are equivalent to the recursive subresultant, and more suit- 
able for efficient computations. The nested subresultant matrix is a subresul- 
tant matrix whose elements are again determinants of certain subresultant 
matrices (or even the nested subresultant matrices), and the nested subre- 
sultant is a subresultant whose coefficients are determinants of the nested 
subresultant matrices. 

Note that the nested subresultant is mainly used to show the relationship 
between the recursive subresultant and the reduced nested subresultant that 
will be defined in the next section. 
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We show an example of a nested subresultant matrix. 

Example 4.1 Let F(x) and G(x) be defined as 

F(x) = a 6 x e + a$x 5 + ■ ■ ■ + a , a§ ^ 0, 
G(x) = b 5 x 5 + b 4 x A + • • ■ + 60, 

Let prs(F,G) = {P[ 1] = F, P 2 {1) = G, F 3 (1) = gcd(F,G)) with deg(P 3 (1) ) 
and let us consider recursive PRS for F and G. 

Let P^ = P 3 , P 2 = 4zPz \ , and calculate a subresultant of degree 1, which 
corresponds to P 4 . By the Fundamental Theorem of subresultants (Theo- 
3.4\ ), we have 



4. 



rem 



d 
dx 



S 4 (F, G) = A 4 x 4 + A 3 x 3 + A 2 x 2 + Aix + A 
S 4 (F, G) = AA A x z + 3A 3 x 2 + 2A 2 x + A u 



where 
for j = 



(4.1) 



A 3 = \Nf(F,G)\ 
4 with N ( k j \F,G) as in Definition\3M 

Then, we can express the subresultant matrix iV( 2 )(S 4 (F, G), ^S 4 (F, G)) as 

I a *a \ 



iy(2)( S4 (F,G),^-S 4 (F,G)) 
dx 



A A 4A 4 
A 3 3yl 3 AA A 
A 2 2A 2 3A 3 
A x A x 2A 2 
A Ax 



(4.2) 



and the subresultant S 2 (S 4 (F, G), j-S 4 (F, G)) as 



S 2 (S 4 (F,G),-^S 4 (F,G)) 
dx 



A, 


4A A 






A, 


4A 4 






A, 


4A 4 




A, 


3A 3 


4A 4 


x 2 + 


A 3 


3A 3 


AA A 


x + 


A 3 


3A 3 


AA± 


A 2 


2A 2 


3A 3 




Ax 


Ax 


2A 2 




A 




Ax 



, (4.3) 



respectively, with Aj as in We see that the elements in fiJJty are minors 

of subresultant matrix, hence the coefficients in h4-3\ ) is "nested" expression 
of determinants. □ 
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Definition 4.2 (Nested Subresultant Matrix) Let F andG be defined as 
in h3. and let (Pi , . . . , P^\ • • • , P[ , • • • , P^) be complete recursive PRS 
for F and G as in Definition {KM Then, for each pair of numbers (k,j) with 
k = 1, . . . , t and j = j k -i — 2, . . . , 0, define matrix N^\F, G) recursively as 
follows. 

(1) For k = 1, let N^(F, G) = N®(F, G). 

(2) Fork>l, let 

m k >i\F,G) = N® (|v lijfc _ 1 (F,G'),^S & _ 1 , jfc _ 1 (F,G')^ , 

where S k -ij k _ 1 (F,G) is defined by Definition \4-3\ Then, N^'(F,G) is 
called the (k,j)-th nested subresultant matrix of F and G. □ 

Definition 4.3 (Nested Subresultant) Let F and G be defined as in (13.1 1) . 

and let (P^ , , . . . , P[ l \ P®) be complete recursive PRS for F 
and G as in Definition \2.2\ For j = j k -i — 2, . . . , and r = j, . . . ,0, let 

a sub-matrix of the (k,j)-th nested subresultant matrix 
N^ k, ^(F, G) obtained by taking the top rii — 2j — 1 rows and the (nf^ + 

r4 ~~ j ~ i~)-th row (note that N^ k <^ is a square matrix). Then, the polynomial 

S kJ (F, G) = \Nf' j) \xi + ■■■ + \N^ k ' j) \x 

is called the (k,j)-ih nested subresultant of F and G. □ 

We show the relationship between the nested subresultant and the recursive 
subresultant. 

Lemma 4.4 Let F and G be defined as in (ETT1) . and let (P^, . . . , PP, . . . „ 

Pi, . . • , P^) be complete recursive PRS for F and G as in Definition \2.2\ 
For k — 1, . . . , t — 1, define B k , and for k — 2, . . . , t and j = j k -i — 2, . . . ,0, 
define b k j as in Lemma Iff. ,91 Furthermore, for k = 2, . . . , t — 1, define R k = 
(Rk-i) bk Bk with R = Ri = 1. Then, we have 

S kJ {F, G) = (R k -i) b ^ ■ Sj(P?\ Pi k) ). (4.4) 



PROOF. By induction on k. For k — 1, it is obvious by the definition of the 
nested subresultant. Assume that (I4.4j) is valid for 1, . . . , k — 1. Then, by the 
Fundamental Theorem of subresultants (Theorem 13.41) . we have 



S^^G) = (R k ^) b ^B k _iP^> = (R k -i)P? 
± (s k .i, Jk ^F,G)) = (R k „i)± (P«) = (R k _i) P ™. 
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Then, we have 



\N^\F,G)\ = (R k ^ \N®(Pl k) ,Pi 



)l 



(4.5) 



for r = j, . . . , 0. Therefore, we have (I4.4p . which proves the lemma. □ 

Theorem 4.5 Let F and G be defined as in (ETT]) . and let (P x (1) , . . . , P z (1) , . . . , 

Pj , . . . , P l ) 6e complete recursive PRS for F and G as in Definition \2.2l 
For k = 2, . . . , t and j = j k _i — 2, . . . , 0, define u k j, b k j, r k j as in Lemma lcTTh 
and R' k = (R' k -i) bh r k with R' = R[ = 1. Then, we have 



PROOF. By induction on k. For k — 1, it is obvious by the definitions of the 
recursive and the nested subresultants. We first show that R k = R k ■ R'k f° r 
k — 0, . . . , t—1. It is obvious for k = and 1. Let us assume R k -i = Rk-vR' k -i- 
Then, we have 



Now, by Lemma EH we have S kJ {F,G) = (R k ^) b ^r kd ■ S^Pf' , Pf>), then, 
by Lemma [4.41 we have 



which proves the theorem. □ 

Remark 4.6 Since r k j = ±1, we see that R' k = ±1 hence the nested subre- 
sultant is equal to the recursive subresultant up to a sign. □ 



5 Reduced Nested Subresultants 

The nested subresultant matrix has "nested" representation of subresultant 
matrices, which makes practical use difficult. However, in some cases, we can 
reduce the representation of the nested subresultant matrix to a "flat" repre- 
sentation, or a representation without nested determinants by the Gaussian 
elimination; this is the reduced nested subresultant (matrix). As we will see, 



S kJ (F,G) = (R' k _ 1 ) h ^r k>r S k , j (F,G). 




bk r k B k = (P fc _! • R' k ^) bk r k B k = (R k ^) bk B k ■ {R' k _ x ) hk r k 



S kJ (F,G) = (P fe _x ■ R' k ,)''- • S^Pf^Pf) 

= (^-i) 6 * J r J y-(^ 1 )^.S i (P 1 ( * ) , J pW) 
= (R' k „ 1 ) b ^r k , r S k ,(F,G), 
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the size of the reduced nested subresultant matrix becomes much smaller than 
that of the recursive subresultant matrix, with reasonable computing time. 



First, we illustrate the idea of reduction of the nested subresultant matrix 
with an example. 

Example 5.1 Let F(x) and G(x) be defined as 

F(x) = oqx 6 + a$x 5 + • • • + ao, a§ ^ 0, 
G{x) = b 5 x 5 + b 4 x 4 H h 60, h ^ 0, 

with vectors of coefficients (a^, 05) and (65, 04) are linearly independent as vec- 
tors overK. Assume thatprs(F,G) = (P^ = F, P 2 (1) = G, P 3 (1) = gcd(F,G)) 



with deg(P 



NW(F,G) is defined as 



4. Consider the {2,2)-th nested subresultant; its matrix 



N {2 > 2 \F,G) 



Ai AA 4 
A 3 3A 3 4A 4 
A 2 2A 2 3A 3 
A x A x 2A 2 
A Ai 



a 6 65 
a 5 64 65 
a j bj-i bj 



(5-1) 



/or j < 4 6j = for j < 0. iVou;, Ze£ us calculate the leading coefficient of 
S 2 , 2 (F,G) as 



\M 2 ' 2) \ 



A A 4A 4 
A 3 3A 3 AA 4 
A 2 2A 2 3A 3 



a 6 65 

a 5 64 65 

a 4 63 64 

a 6 65 

a 5 64 05 

a 3 o 2 03 

a 6 65 

a 5 64 65 

a 2 61 b 2 

H\ = 



a 6 65 
a 5 64 05 
4a 4 4o 3 4o 4 

a 6 65 
as 64 65 
3a 3 3o 2 36 3 

a 6 65 
a 5 64 o 5 
2a 2 26i 2o 2 



a 6 65 
a 5 64 05 
0a 4 06 3 06 4 

a 5 64 65 
4a 4 Ab 3 46 4 

a 6 65 
a 5 64 65 
3o 3 36 2 36 3 



(5.2) 



H, 



Then, we make the (3, 1) and the (3,2) elements in H p q (p,q = 1,2,3) equal 
to by adding the first and the second rows, multiplied by certain numbers, to 
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the third row. For example, in H^x, calculate xn and yn by solving a system 
of linear equations 

( a G x n + a 5 y n = -a 4 „. 

S r 7 f J (5.3) 

{ 65X11 + b A yu = -63 
(Note that ( (5.51) has a solution in K by the assumption) , followed by adding the 
first row multiplied by xu and the second row multiplied by yu, respectively, 
to the third row. Then, we have 



Hi, 



a 6 65 
a 5 64 65 
/in 



a 6 65 
a 5 64 



/in with h u = 64 + 2/1165. 



(5.4) 



Doing similar calculations for the other H p>q , we calculate h Piq (p,q = 1,2,3) 
for H P) g similarly as in (f5.^| ). Finally, by putting such new representations of 
H P) q into 115. 2\) . we have 



IN. 



(2,2), 



a 6 65 
a 5 64 



/in hi2 hi3 
hu h 2 2 h 2 % 

/i31 hs2 hss 



a 6 65 
a 5 64 



I AT, 



(2,2), 



(5.5) 



note that we have derived N^ 2 ' 2 ^ as a reduced form of N^ 2 ' 2 ^ . 



□ 



As ( 15. 5p shows, we derive a "reduced" form of the nested subresultant matrix 
by the Gaussian elimination for solving certain systems of linear equations. 
We define the reduced nested subresultant (matrix), as follows. 

Definition 5.2 (Reduced Nested Subresultant Matrix) Let F and G 

be defined as in (13~11 . and let (P x (1) , . . . , p£\ . . . , P} t] , pj?) be complete 
recursive PRS for F and G as in Definition \2.2\ Then, for each pair of num- 
bers (k, j) with k = 1, . . . , t and j = jk-i — 2, . . . , ; define matrix N^ k, ^{F, G) 
recursively as follows. 

(1) Fork = l, let N^(F, G) = N®(F, G). 

(2) For k > 1, let N^~ 1Jk - l) {F, G) be a sub-matrix of N^' 1 '^ (F, G) by 
deleting the bottom j^i + l rows, and N^ Q) be a sub-matrix of 
N(*>-ijk-i)(F^G} by taking the bottom j^-i + 1 rows, respectively. For 
t = j fe _i, . . . , let N( k ~ 1 < jk - 1 ' ) (F, G) be a sub-matrix of N^-Un-i) (F, G) 

-1 — r + l)-th row 
l^fc-Uk-O] and 

construct a matrix as 



by putting Njj ^(F, G) on the top and the (jk-i 
of N ( L~ 1,jk - l) (F,G) in the bottom row. Let = 



(H^) = U^ix), ±A^\x)\ , (5.6) 
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where 



x) 



+ 



i(fc-l) r i fc -l 

r (fc-i,iA-i) 

" CUIbSlSLS UJ iV 

express JMjj 

is a column vector, and the row vector in the bottom by ( blV^ 



5mce iV^ fc consists of L,Jk 11 and a row vector in the bottom, we 

"'" ' ' ^[/( fc ) \v^ k ^j , where is a square matrix and 

n (k,j) 

where b^' is a row vector and g^g is a number, respectively, such that 







h(k,j) 


a (k,j) 



(5.7) 



with b^'.p = and q^;p = for H^' = 0. Furthermore, we assume 
that is not singular. Then, for p = 1, . . . , rii + — j and q = 
2, . . . , rii + ruf 1 — j, calculate a row vector x(® as a solution of the 
equation 

(5.8) 
(5.9) 



•^p,q u ~ u p,q > 



and define h p k J^ as 



h(k,j) 
n p,q 



Note that we have 



Jj{k,j) 



p,g 



U(k) 


v (k) 





h(k,j) 
n p,q 



U (k) hff. 



(5.10) 



Finally, define N^\F,G) as 



N (k ' j) (F,G) 



( h (k,j) h (k,j) 

"1,1 ''1,2 

h (k,j) h (k,j) 

"'2,1 "'2,2 



h 



(M \ 

(M 



h ( ' 
"l,J, 



2.,/, 



k,j 



h (k,j) 



(5.11) 



where 



J k,j 



n^ + n { 2 k] -j = (2j k _ 1 -2j-l)+j, 



T (fc) . (fc) 

Jk,j = n\ + n-2 



2j = 2j k _ 1 -2j-l. 



(5.12) 



Then, N^ k, ^(F, G) is called the (k, j)-th reduced nested subresultant ma- 
trix of F and G. □ 



Remark 5.3 Definition 15. £1 shows that, For k = 1, . . . , t and j < jk-\ — 1, 
the numbers of rows and columns of the (k,j)-th reduced nested subresultant 
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matrix N^(F,G) are I k j and J k j in 115. lfy) . respectively, which are much 
smaller than those of the recursive subresultant matrix of the corresponding 
degree (see Proposition 3.1). □ 



Definition 5.4 (Reduced Nested Subresultant) Let F and G be defined 
as in d3HD, and let {P[ x \ . . . , . . . , P?\ . . . , P®) be complete recursive 
PRS for F and G as in Definition \2.2[ For j = jk-i — 2, . . . , and r — j, . . . ,0, 
let Nf*) = N^(F,G) be a sub-matrix of the (k,j)-th reduced nested subre- 
sultant matrix N^ h, ^(F, G) obtained by the top ra^ +r4 — 2 j — 1 rows and the 
(jii + r4 — j ~ T)-th row (note that N^. k '^(F, G) is a square matrix). Then, 
the polynomial 

S kJ (F, G) = \N<- k ' j \F, G)\x j + ■■■ + \Nt' j \F, G)\x° 

is called the (k,j)-th reduced nested subresultant of F and G. □ 

Now, we derive the relationship between the nested and the reduced nested 
subresultants. 

Theorem 5.5 Let F and G be defined as in (I3~T|) . and let (P^, . . . , P z (1) , . . . , 
, P/ ) be complete recursive PRS for F and G as in Definition \EM 
For k = 2, . . . , t, j — jk-i — 2, . . . , with J k j as in \5.11\) . define B k j and R k 
as 

B kfj = \U^\ J ^ 
with B k = B k j k and Bi = B 2 = 1, and 

R k = ■ P fc -i) Jfe * 

with Ri = R 2 = 1; respectively. Then, we have 

Sk,j{F, G) = (R k -i ■ B k _ 1 ) Jk ' J B ktj ■ S k j(F, G). 

To prove Theorem 15.51 we prove the following lemma. 

Lemma 5.6 For k — 1, . . . , t, j — j k -i — 2, . . . , and t = j, . . . ,0, we have 
\N?*\F,G)\ = • P fc -i) JfcJ 4,,|iV(^(F,G')|. (5.13) 

PROOF. By induction on k. For k — 1, it is obvious from the definitions of 
the nested and the reduced nested subresultants. Assume that (15.131) is valid 
for 1, . . . , k — 1. Then, for r = jk-i, . . . , 0, we have 

\N( k -^\F,G)\ =(4_ 2 .4-2) J *- 1J *- 1 4-i^_JJVi fc - 1 ^(^G)| 
=(4-i-4-i)l^ fc_1 ' ik - l) (^G ! )|. 
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Let 

^(fc-i) = l^-^-^^G)!, = \Nj!°- 1 >>'- 1 \F,G)\, 

and H( k 'fi = (h^^ be a sub-matrix of in 05.61) by taking the top J k j 

rows and the (I k j — r)-th row, where I k j and J^j are defined as in (15.1 2p . 
respectively. Then, we have 





jfe-i 






7* ii (fc_1) 


if*- 1 ) 




(2j - i fc -i + 3)ig: 


-i) 

-ife-i+3 


• (J + 2)if + - 2 1} 


^i-ifc- i+t+2 




(j-Jfc-i + r + 2)if_ 


-i) 

jk-i+r+2 


• (r + 1)4^ 



where A\ k — for I < 0. On the other hand, by the definition of the (k, j)-th 
nested subresultant, we have 

\N^\F,G)\ 











71. ii (fc_1) 


I(fe-i) 


• i (fc-1) 


(2j-j fc _i + 3)ig: 


-ifc_i+3 


• U + 2)if + " 2 1) 


^i-ik-l+r+2 




(j-j fc _i + r + 2)lf_ 


-i) 

jfc_ 1 +T+2 


• (r + l)^ 



'-{Rk-l ■ -Bfc-1 

r(fe-i) 



(5.14) 



where ±; = for / < 0. (Note that JV^') and tf^') are square matrices 
of order Jk,j-) By Definition 15.21 we can express H^ k '^ as 





„(*) 







with bf^ = and g} k ' j) = for = 0. Note that, for q = 1, . . . , J fcJ , 

we have b^'- 7 ) = b&p and fl^*' 3 ') = gf'^ for p = 1, 

and 9? k ^ g = 9%f-T,v where & & 
respectively. Thus, by (I5.8h ( T57TTj) . we have 



, Jfej — 1, and b 



" /(/ " JI — where and ^IV-' are defined as in (15. 7p . 



I^fcj)) = \U^\ J ^\N^. k ' j \F,G)\ = B k jN^ j \F,G)\, 



(5.15) 
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and, by putting f 1 5 . 1 5 j) into (15.141) . we prove the lemma. □ 



Remark 5.7 We can calculate the (k, j)-th reduced nested subresultant matrix 
as a sub-matrix of the (k,0)-th reduced nested subresultant matrix. In (15.61) . 
we see that the matrix H^'^ is a sub-matrix of N (A( k ~ 1 ') (x) , -^A^^^x)^, 
and, by the construction of the reduced nested resultant matrix ( 15.111) . we see 
that M k ' j \F,G) is a sub-matrix of N^ k >°\F,G) by taking the left n ( 2 k) - j 
columns from those corresponding to the coefficients of A^^ix) and the left 
n i ~ j columns from those corresponding to the coefficients of ■4-A^ k ~ 1 ^(x), 
then taking the top rii + r4 — j rows. □ 

Remark 5.8 We can estimate arithmetic computing time for the (k,j)-th re- 
duced nested resultant matrix N&'i) in ( 15. lip , as follows. The computing time 
for the elements h Pjq is dominated by the time for the Gaussian elimination 
of U( k >. Since the order of (k = 2, . . . , t) is equal to 2(jk~2 — jk-i — 1) 
(see Remark [57^) , it is bounded by 0((jk~2 ~ jk-i) 3 ) (see Golub and van Loan 
[9]j. As Remark 5/T_ shows, we can calculate N^ k, ^{F,G) for j < j^-i — 2 



by N^ k '°^(F, G). Therefore, total computing time for N^ k '^ for entire recursive 
PRS (k = 1, . . . ,t) is bounded by 



E 0((j fc _ 2 - j k ^f) = O (£0*- a " h-xf) 

k=2 \k=2 ) 



O(( 3o - jt-i) 4 ) = 0(m d ) 



note that jo = m (see Remark \2.3\) . See also for the concluding remarks. □ 



6 Concluding Remarks 



In this paper, we have introduced concepts of recursive PRS and recursive 
subresultants, and investigated constructions of their subresultant matrices 
to compute the recursive subresultants. Among three different constructions 
of recursive subresultant matrices, we have shown that the reduced nested 
subresultant matrix reduces the size of the matrix drastically to at most the 
order of the degree of initial polynomials in each PRSs, compared with the 
naive recursive subresultant matrix. We have also shown that we can calculate 
the reduced nested subresultant matrix by the Gaussian elimination of order 
at most the sum of the degree of initial polynomials in each PRSs. 

From a point of view of computational complexity, the algorithm for the re- 
duced nested subresultant matrix has a cubic complexity bound in terms of 
the degree of the input polynomials (see Remark 15. 8p . However, subresultant 
algorithms which have a quadratic complexity bound in terms of the degree of 
the input polynomials have been proposed ([B], [EE]); those algorithms exploit 
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the structure of the Sylvester matrix to increase their efficiency with control- 
ling the size of coefficients well. Although, in this paper, we have primarily 
focused our attention into reducing the structure of the nested subresultant 
matrix to "flat" representation, development of more efficient algorithms such 
as exploiting the structure of the Sylvester matrix would be the next problem. 
Furthermore, the reduced nested subresultant may involve fractions which may 
be unusual for subresultants, thus more detailed analysis of computational effi- 
ciency including comparison with (ordinary and recursive) subresultants would 
also be necessary. 

We expect that the reduced nested subresultants can be used for approximate 
algebraic computation such as the square-free decomposition of approximate 
univariate polynomials with approximate GCD computations based on Sin- 
gular Value Decomposition (SVD) of subresultant matrices ([1], [7]), which 
motivates the present work. For the approximate square-free decomposition 
of the given polynomial P(x), we have to calculate the approximate GCDs of 
P{x),..., P { - n \x) (by ?W (x) we denote the n-th derivative of P(x)) or those 
of the recursive PRS for P(x) and P'(x); we have to find the representation of 
the subresultant matrices for P(x), . . . , P^ n '(x), or that for the recursive PRS 
for P(x) and P'(x), respectively. As for the former approach, several algo- 
rithms based on different representations of subresultant matrices have been 
proposed ([5], [13]); our reduced nested subresultant matrix can be used as for 
the latter approach. To make use of the reduced nested subresultant matrix, 
we need to reveal the relationship between the structure of the subresultant 
matrices and their singular values; this is the problem on which we are working 
now. 
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Fig. 1. Illustration of N^ k ' j \F,G). Note that the number of blocks N ( L l,jk ~ l] is 
jk-i — j — 1) whereas that of iV L is — j; see Definition 13.61 for details. 
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Fig. 2. Illustration of M^ k '^(F, G). Note that the number of column blocks is equal 
to bkj = 2jk-i — 2j — 1; see Lemma f3. Ill for details. 
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M (k ' j) {F,G) = 
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Fig. 3. Illustration of M^\F, G); see Lemma EE] for details. 
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Fig. 4. Illustration of M( k 'i\F, G). Note that the lower-right block which consists of 
p[ k) andp£ fc) is equal to iV^P-f^P^) and = |jV$ k_l) | = 1; see LemmaEnU] 

for details. 
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